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ABSTIACT . ^ - ^ ' v ' 

A joint research project in educational tfchniquas^ 
which was conducted ty the oaiversltj cf iatexlco and the IIH 
Coxporation* explored the jaSe of color television with raxdpm*acceas 
videotape under computer eontrol- At the end of the' tlre€**y€ar 
projectr paperA were solicited frosi all CCEIl (CoBputeriaed 
Hultl*Hedia Instructional Television) patticipatitSr and 12 cf the 15 
professors who had luthcred eouisei sofcrnitted papers* A 
representative sample of sev^^^tfpers was presented' "^t a one^day 
COHIT Syoposiufflp some accompanied by videot tfpi^^deaienstxatipns that - 
illustrated the teaching techniques cfied, ic ordisr to pxoiidfe as 
cofflplete a record of the project as possible, alls 12 of the papers 
from participants are iricluded ih this volune (gropped^ where 
possible^ by subject), as well as coaffents bj the project director 
and the coordinator from iBH^nd a sunmaxy cf the fe|agogical lessons 
learned from CCMIT. Courses ^scribed include enviroiifliental 
enqineerinq, survey designf advanced calculvi, cyanic sjiithesis, 
bioloqy, human nipyement, ice hockey practicip foottall\ 
experienc#r history of "axlp and English* The appendii 
schedule for the COMIT Symposium with the nanes of the 
(Author/JEG) 
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€bi Septenber 1974 ^ the IBM Corporation approaehed the University 
of Waterloo with a proposal for a joint reaeareh project In educational 
t^^nlqtias w^ch would eKplorSs to partleiilar/ the use of colour tele- 
vlslofl with random ^ aceeas video-tape tmdar eo^juter control. The pro- 
poaaL^was ^ef e^rmi by^ Dr .^X 

to the Conputers In Education Comilttee (CEC) £o^ evali^tion and co^Benta. 
After some negotiation between TO and IBMp the project begm officially 
in Jmuary 1975 with the name COJCT (for Conputeri^d Multi--medla Instruct 
tlonal Xelevlalon) p with Dr. J«B. Hoorep Associate Frofesaor of Hanagenent 
Science J a$ COMT Project Director and with E*0, Elkeer repreaentlng IBM* 

The Con^uters in Education Comittee maintained an informal contact 
^ with COICT during its three years of pperation andp as the termination 
d^te (15 April 1978) approached , members of the Committee volunteered to 
assist in disseminating the toowledge obtained from the project. , An 
editorial sub-committee was appdinted and papers were' soliQlted from all 
COMT partlclpaits , Twelve of the fifteen professors who mad participated 
In ^COHIT as "course authors" submitted papers and a representative sample 
of seven papefs was selected for presentation at a one-'day lOMIT Syn^osiiun 
.held on Thursday, 6 April , 1978, Some of the Symposium pt^sentatlQns were 
accompanied 'by vldeo--tEpad demonstrations that illustrated, effectively , 
tiie teaching techniques used . 

In reviewing the submitted papers for publication in this volumk^ 
the editors felt an obligation to produce as complete a record of the 
project as possible, while maintaining an accaptable standard of content 
and format. Not all of the papers submitted conformed to the specifica- 
tions in the Cal^ for Papers and^ In some cases where it was not feasible 
to return papers to theirl authors for revision, the editor^ arranged for 
re=typing and made some mlnoT modifications and condensations. The re-^ 
suiting volume Is believed to a fairly mmplete reenrd of the COMTT 
Project as described the pflr tied pant ^ . vnluro^ should nnt , b^w- 

ever, be mistaken for the formal report of the proj^rt which bp pre- 

pared by the COHIT Pro ject Director and readers who ^snt tnorp 1 n rorm;^ r i on 
shoiJ.d contart rhe Dlrectdr. 

(1) 3 



, The papers which follow are arranged in ^ jbather^arblttary order- 
Tha eosEents of the Director and the IBM Coordtaator ara firsti^ followed / 
by the papeVe from twalvi of the courBe aut&rs (liircjiiped poaalble/ 
by eubject), followed by a concluding paper by Dr. C*K, to^pir, the / 
Itaiveraity of Waterloo's Teaching Reioi^ce Person, aimromE^ni tits pada" 
gogical lessons learned from COHIT^ The appendix con^insj,. tne tschediile 
for the GOMT S^^oalum, showing the SympoBitm speakem. / / 

Chrliftopher K. Knappe 

■1- / ■ 

«- . ' ' . ^ 

6 July, 1978 ■ . \ 
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An O^ar^ewlbf the CQMIT Project 

J.B* Moorfe, COmf Project DlMctor ' 

CQMIT; ExpeHanceb and Qbseivatlons . 

E.O; Eliaeri IBM CdMIT Project- Coordinator 
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/ CoTOutret-Alded Tealchlns In Environmental Englnearlng 10 
1*A, HcBaan,~Dip't of ClvU Ettglnaerlng 



Armchair Surfe^ey Saap'llngr M Aid In Teaching Surv^ey Daslgn 17 
H#E. ThonpsonJ D^p' t of Statlstdca / \ ^ 



5. A COICT Modtlla a Topic from Advanced Calculus 

B*J, Harshnan^ Dap 't. of Applied Itothettatlcs 

*" * 

6. ^ Computer-Arislstad Ingtr^ptljn lii Organic Syntheals 

v. A. Snleckua* Dep- t of Chemistry 

1\ ^ Application of CQMIT in Biology 

W , B . Kendrlck j~Pap - t~of Biology ^ 
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The Potential Use of CQMIT la the Stndy of Ht flsan Movement- 53 
D*A, Winter, Dep't of Kinesiology 

CQMIT ^Ide Hockey Practice 

R*C* McKlilop,^ Dep't of Athletics 



10, CQMT^ Football Module . 

W*A* Deiahey, Dep*t of Athletics 

11* CQMIT: the Leis ure Experience 

E,M, Avedon and Stawart% Dep't of RecraatloTi 

12, CQMIT as a Taachlng tool for the Histor y of Art * 

E* Klinian, Dap,*t of Fine Arts 

^ is 

' 13,, CQMIT Bagllsh Module » 

P.D. Beamt Dep't of English 

^4* Ref lefftlpns .on a CQMIT 'Module 

D.IC* Erbi Dep't of Geography 

1 5 . Learning fros COMITj T^e_ Educational Imp l ide ations 

C#K* Knapperj Teaching Resource Person 
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AN OySEVIEM OF riE OMI^ PROJECT v ^ . » 

-^^Sbfin B . Moore 
Aaaoo^te Profeasor of Miaageffient Seleace 

C^nx Project Dirsctof ' ' 

Univaralty of Waterloo i 

■/ ■■ . ' ' ' # " 

|( of th^ cronT resesrrtL projects Mghlighca' thd major 

accoTOjllshmnts s and proirtdaa a ysubjeotlve evalmtiqri of jfhi 
beEnits eoats of multl^'^dl^ conputer-aided^lnatruetion, 

latroductloti g " . ^ 

. Thm, acroaym rnMTT^ ntanAing far Conp^erleed Multl-^fedla InatructlOTal 
Televlalon^ was ehoaan to identify a major research project In cojaputer^ 
aaslsted learmlng (CAL) whlch'wM imdert^en jointly by the Univeraity 
of Waterloo and IBM at the IMlverBlty of Waterloo, The project began 
Ld- Jmuaiy 1975 apd the research was co^leted In March 1978, 

The main goal of the research waa to Integrate the educational 
^technoiogies of televlalon and into a eingle delivery ayatem* The 
objective was to deten^ne whether the co^lned technologiea woyld result 
In a learning vehicle which would have significant advmtages over 
either educational televiaion dr cdnventlonal CAL, 

The responaibility of IBWwas to develop the mique hardware 
interfaces and software, that of the University to provide the application 
(courseware) to be uaed in the experimenta. 

It was decided at the outset to include as mmy audio^vlaual 
fimctlons in the experimental system as was reasbnably possible, subject 
to the requirements that the audlo^vlsual hardware co^onants should be 
com^rcially available and that eJks ting* CAL authoring Imguages should 
be used. (The languages necesMrily were augrcnted with comnands_^ 
control the audio-visual devices ^)-^The/ following functional componentrs 
were selected sad synthesized into a working termlnal^system: 



a stmdard SOOT *colour televfaion ricelver^ . 

' ~ t 

- a standard 3270 keyboard id.th i^per/ lower 

*f clmraefifir set md a 5th programaabie ^araoter set.. : 

^ a sonic pOT with a dlsmoimtable pickups which prb^dad 
a 220 by 330 grlB of addressable Cdatectablfe) points 
on the screen surface ^d. eapablllty for ofi-^^reen 
detects K ' 

"^^ T" f ace liable p tin t e r f or bb t alnlny^Kar d cbpy o ut p ut ' o f " 
seraen displays 

^ direct access to, video tape se^ents 

. direct access to audio tape segMnts > • 

^ direct access to a video disk which conlcl store 550 , 
35m slides ^ 

- colour gr^phlW under pen^ keyboard or pyrbgram control, 

^ ^ - % ^ ~ ^ J - : ^ . 

All video o'utput appeared on the television screen affd audio ou^ut 
was preaanted through earphones* ^ =/' . 

The system consisted of four terminals with the above capabilities 
comae c ted to a System 7 mini compute r,-^hii^ in turn was channel- connected 
to the Qalversity's System/370 Mode| IJfi^ The cQursewareS was resident 
%n the 158 ^d the System 7--158 protocol was similar to that used for 
a 3270 control imit. The System 7 controlled all tfie audiovisual 
library devices and generated and stored the colour graphics* 

.^Two major^rograOTQlng Imguages were i^ed ,for auth^ing* a modified 
version of IIS and an enhanced form of APL* 

The^ EKpirlments ' 

\ iStl^lly^ thirty professors were contacted and given the opportunit 

^o p^rtlJcipate voluntarily In the project* From this froap fifteen autho 
h^BMB involved and entered the process of topic selection, construction 

"of .^earning objectives^ detailed presentation design^ and Iniplemail tation . 
The^ontent In most cases covered approximately three ^tn fnur hours Q& 
lectrtiW tnafprial. The^ ^#lprt1 on nf fbe'p^d^gngy fdrill pr^^-t-f . \ / 

tutorial, slmulati^^n, Inforniation rerri-val, ef-.) ^^^^ l^^^ ' 
author/' Eac^ aut^ioi^ (prof^p^or^ wcrkp'^ rlogoly tjirh n* i)^^ pr^^j 

flnalysts> and c^d^f^p H*-'^^ by r'-<=>1v'<c -♦mH--^' ■ '^irr ' ^ f"^ ^ ' ' < 



bipio^s Sci^J^h^ p0etfy^' watar ^oilutlont- calculus, .fp^tballV sMifeistlcl^ 
balEi'lJSed a tutortaj^ presentation | the at^^s we^^ iniKtuMe o£ sliiKLatlprii \ 



Btuda^s ai^haire from one hpur ^Qgnitte to ep^-^sw. ^ar 570 
studpiits parttdfl^tad in the a^a^Mttto ^d^hls^^^u^^ upwards ' . 

of MOO hours of te^dnal ttm sp|fe^d ov^EuM months, ' , ■ 

Evaluation I / i , ! 

In "four axperlnientss , the class was dl^idrfd into two gtoups — a iiontrol. 
group was taught tha material In the usual lecture f Mshion and' to e^^erl^ ^ 
mental group took the aame material usjpg the CO^M system. 'Itt^e'ptl^i. 
experiments, either the whole clala^t'te^m in the case of the '^lle^allsV 
football and hockey modulas) or a selected xaubset of the class used the s 
research system. Six of the Experiments warejrm more than pnce.j. ' 

Results I 



■ 

mm t 



Hie IMiversity' had three questions to which It was hoped the research 
would provide the answers s j • 

First ^ Do atudents^^iam better with multi-media CAL? Ifi all four 
experiments where direct comparispns were madej the students using the 
system had^slightly higher average scores on post'-tests than the students 
in the le^i^re group. The differences in each case were not statistically 
signi|lcmt^ No riga^us attempt was made to measure changes in affective 
behaV±0^ of the COMT students. However, a questionnaire given to students 
after cOTpletlng the coi^uter session showed generally positive attitudes 
to this form of leai 

Second ^ Can resources be saved using a multl^media terminal? Th^ 
pre^project conjecture was that the richness of the terminal environmant 
would allow realistic simulations nf laboratory experiMnts to be 
eo«ducted^ thus providing pofFntl^l savings In lab ^qulpm^nr. No f ^ 
conriuslon was reached because no wpII rontrolli^H eiepprl men w^ro Hon^. 

( 



.^SonefehelesSp studenta participated wftlingly ig tha labbratory simulations 
and gha, infonation retrieval program used with the art Hiit'O'ry slides ^ 

' had a^hlgh utllijty. In three 'lnst)mces (thetii^ of in^terest,^ history of 
leisure and statistics) slgiilflcrat amounts of profespor time were saved 
omoe the respective fflpdulea ware opa:^atloaal. Against the potential 
Qavlnga ii|ust be weighed the ^creased ^^!^^^ required for computer and 
audlo^y^sual spaclallsts^cQsiputer time/and author development time. 

Third * mat la the potantial of multi-media CAL for eKtramural 
education? It la In^Ais aria that perhaps the greatest potential benefit 
lle« With the advent of ml crtfcoi^ uteres low cost terndnalSp video disks 

-end cheap maas storage ^ the use of multi-^medla CMi bacoMi^diflnitely 
feasible for home education^ correspondency programs^ remedial leading 
tad speciai education. Such uies mak e It possible to spread the high 
capita cost of courseware davelopmnt qvbt many Independent users. 
Without such uses the problem of justifying a multl-itedia CAL systjem 
for in-house use only Is mueh more difficult- 

Some Lessons Learned : 

In terms of ability tb enhwce conventional CAL with multi=media 
attributes, the following list is arrmged in order of decreasing priority 
of fimctloni graphics , colour , slides, tapes (^u^io and video). This . 
ranking represents a consensus of the views of the project personnel. 
Experience taught us also that gqoA riisponse time was vital for modules 
in which all student input was done. with the pen* Pan resolution and 
calibration is extrem'ely Important when two^or more detectable areas 
are clos^ together * Also, production of auilp^visual matarlals was and 
is a v^ry tlme^^cdn^i^irig procesm Telative to coding. In some instances , 
we chose to omit a potetttl^lj-y valuable^tape segBtent* because of the 
production factors invqjved* . • ^ 



Conclusions i \^ 

The CO^T project must be considered an hyetall success in that 
almost without axceptlon, the original objectives of fh^ r^Rearrb w^rp 
achieved* Aside from the observatinng mad^ pr#vlous^v, ^^^^ rrtit-h nf 



the fellowing thrpe statements was sul^stantlated by the* experiencas in the 
projeet 1 



1, CAL em use multi^^edla effectively but it is "hot 
esaemtial good CAL. V 

2, GOQjd CMi requires a team effort/ The author la the 
most i^or^ant tew member. 

3, T^fiKnb33o0^i not" tfttf ^ll4&t^ffig^acWr'i^ dtfrolopmen t , 



The papera which follow provideVthe Indivi&ual viewpoints of mglt of 
the fifteen participating professors. They are well worth reading. 
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XOMlTl , lOTERIlNCES AMD OBSMVAllONS 

^ ^ by . ■. ; ' 

Eileen 0* Elkeer , > 

Advisory Education Represantatlve ^ , 
\ . ^ ' IBM COMIT Projact Coordinator^ 
, , IBM Canada Llmitad ^ 

^ - Abatgact g " :^ls ^apar "^s -prepmrad-frbm the activities of a = 
Joint Study imdertaken. by IBM Canada Llmitad and the Unlver-* 
slty Wat^floo* ^ The study^was glvan the Acronym COMlT* 
(for ComputeriEed Multi^edia^ Instructional Telavlston) and- 
the objective of the study was to determine the value of an 
* Interactive s .coBflJuter--drlven multl^aedla teaching tarminal 
brsed upon television technology* A few of the eKpariencas . 
and observations are recorded in this paper. 

Introduction I ^ 

CIMIT was a truly unique and leadlng^dge system based on TV ■ 
technology. It km^ the first kgora system with a standard colour TV 
set used as the basis of a terminal with the range of multl-^media. 
that was available to the teacher and student. The multi-media inclu^ 
*ded randoiaiy^accasstble motioii sequence^* randomly-accessible audio 
sagmants^ still images, a pen with tablet for^ pointing or digitizing ^ 
prograiBflable colour pnd line graphics • 

Fifteen modules or course segments were implemented utilising a 
cro^s^section of the media. They repreaented all six UW facultlta and 
^employed a Variety of teaching and learning techniques. The students' 

r 

comme^nt^ ab^ut their es^eriences and reactions * as well as their 
learning achievements. Indicate that this type of terminal is a work- 
able learning tool, ^The professors' experiences Indicate that this 
type of system is a valuable teaching resource* COMIT posed no con^ 

*'^8traintBon subject matter, teaching style or learning mode. In fact, 
tutorial moda was, more readily implemefitable than in traditional GAT. 

Over^W students used the system for over 1900 student hours 
studying one of the fifteen niodul^.q. All classe^^ that ran pre^r^Bt^ 
and post' t^€*pts found a ftHght pn^lrlv^ advantng^ in f^vnwr of the COHTT 
students. Thf* inrrpment in not s ta t 'fcp lea 1 1 V gni f 1 , h^\t ^h^ tre 

ts enconraging ^^^a^f^ing ^nr ut'^n<*<' * ^^aarcb \^<^rAr,^^ j^,.a fi^e>» i--fTT>' 



/ ' • ^® tt^^^^lP^Jtfcl-fflidia es^ande the range ©f topfca that can read- 

ily be lmpiem^t|d ^ Some of the modules would never have 

g ' I been tried wl^holit mea|a»* No significant Increase in pomputer rBBOurce 
/ was required to ace^mabdaper the multi-imedia* 

Mjire people J vls-a-v|8 'conVenti^^ CAI^are required to obtain 
erfectlve utilization of fchicaudlo^and video f mictions Asaistanca 
from Audio/Vlsualj Graphit 'Services and the Lariguage Laboratory were 
required and greatly appreciated. 



/ 
J 



Authorlpg Approach ^ * . ^ ^ 

A team approadh was 'uaec|« As professors* time was voluntary * we 
attempted tp use them as subject matter e^qjerts only. Co-op students 
were given training in authoring * coding, and making calls* Their 
function was to interact with the professors in docimenting the object-- 
^ ives and the flow of the presentation. From the professor's script or 

lesson notes, they prepared a ptoryboard which showed the detailed con- 
tent on the screen and on the audio tape. As well, it included pict» 
wes and graphics. Once the level of documentation was satisfactory to 
the team members, tha student coded it. Only one professor did his o\m 
coding. By using the team approach, we feel we best utilised the time 
and talent* of the subject matter expert* The co^p students were chall- 
enged with new content and utlliEation of time. Their Innovatlveness 
produced some beneficial by'-products such as code and improved techniq'^ 
ues * 

The ability to use still Images under computer control and the 
digitizing aspect of the pen were great time savers for the team. Still 
Imajes saved a large amount of verbalizing, and dlgltlElng allowed thosfe 
blackboard kinds of sketches and diagrams to b© easily Included, |^ 

Professo rs - Reactions 

Quality of teaching was enhancad by allowing some bf th^ course ^ 
material to be removed from the lecture load. Pre'-requlsi re or supple- 
mental Mterlal was put on the terminal aystam. Also, the COMIT module #J 
could include more learning altemaMves than could be used in a class ^ 
An example is the Fnononiics inodnle. Th^ computer nindule woniH gr^^flv 
assist in detert^ng thp prohl^m.^ of ^riidenf^ in a pArH^^til^r trrp^r, so 
^hat th^y rould sppnd rb^ fu^^r^^l nn 8 f^lscussinti - (f« probleffi 
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Sa^le totals 



PH 



FY 
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Sarvlba 
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' 0 
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Craftraan 
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23.2 


26.8 


Labouirer 
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• 0 
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4.0 
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13 
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73 
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Yea ^ 
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10 


10 
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49 
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No 
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17 
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20.5 
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xA^y auglt to do soin^rttng aboatiatl ttiM^fltEty soap operas" a troi^l^ 
Vhky £d\mi tha teerelaa itaalf tiBSOnably enjoyablfcUna not difficult ' 
Ciftiordtag to oiik studiats% not difficult enough). Thi^ ieratd to^ t& eiuitm 
ijntmtmBtmi In ElieWwulta /th€ cwnblM^ 

gTia P^obabJLllty San qpljii^ S:^agclia ; ' /^^"^ 

1?hfe e^irct^e callad J^ffLING £s "mora tschnlcal In nature, j H^t^ 

tilt icud^nc Is Bot to ^'totarvlOT" occ^anti of tb^ households , tsut 
rjqiairsd to "desl^" . a pjrofcibll ^Upli £oF S^tfefriiig ^ housahqld eharmcter^ 
titles a©d "tait" the desigtt . 

rha first thing that the stud^t Is asked to do is to "jtratlfy" the 
bloeks oj tha tewn into nott^ovMlapping "itrata"* Ha she my dasigaat<i 
tli t^vn as onm largi stratum, may scratify the torn Into tha four ^onas^ 

wBy aaiiga blocks to stwta la My ochtr wayt The sample of housaholds 
W^4ll tbaci ba the unioii of aubi^pl^Bi one from each ttrmtum. The atudwt Is 
%aked to spaclfy tha nvab^T of households to be selected in each of the 
itjb^awpias. He oi: she must/thari specify the saffipling design to ba used 
tct tbt Sttbsasplas, arfd liaa Coui options (iee [1] for definitions of th^ , 
t«rmiMtagy)i ^ ^ 

ki slJDpia faodom sMpllng o€ hcusaliQld^ 
E ; gystamtlc aaApllag of h^uieho^ds 

two stags ssi^lings In wblefc a siopla random sample of blocka la 
selaati^d flrati and tha houaiholdi to ba sailed atm. selected from theae 
blocks^ 

Di furttiar stratification by buHdini types followed by alapla randoiD 
sajapllttg 'Within strata* 

tt C cr D Is chosCT^ thira are mote detallsd sampla 8±^e specifications to 
hm iMde. 

Osice the design la conplttely spec tf led, tha program Ijnplments tha 
d^iign oocs, ahd displays aitlmataa of quantities like the proportion of 
heuaaholds vlth head having % specified occupation, or chg average nuober of 
ctilldt^ aged 0-4 per household; together with these mre shown agtlm^ited 
acmd^Td arroTs of afitlmation. T^ aUo prlnf<5 out: cHp pnpulpr^on .'^lue 
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,for*tach quafltley and the theoretical staftdard error of dBtlmation under the 

Xr^ the assoelatad Isharatoiey aeslgment In the Winter pf ,1978 the 
^ mtuimntm wsra asked to try out thm vai^lous options, wltli daslgn parattetare 

asamlaifetlia results to SM tf tha^ wera in aceordanee with theory, for 
ftMople^ thtoratlcaUy a dispsrsed sraple (syeteMtlc or stMtlf tad by ^ona 
and allaeatad to tha aonaa proportlonaUy) shDuld be ralativaly afflclTast, 
and tand to have lower theoratiealjitandard arrorj^than a clustered SMpla 
(two staga witha^eral houieholdg Jahosen from each aaopled bLock)* rha 
a^udatits ware asked cofflpars the performance of theae^samples with that of 
the. quota sampla in estiaattag ^tha aistrlbutloii of occupatton of household 
head. Finally, thay ware askad to design a s^la which would be mora 
"efficient" than any of the prascrlbed ones for egtlmatlng the averaga 
tiimbar of preschaol ohildrOT par housahold. 

An unexpected featura of thle eKarelee was the finding that as In real 
llfa^ there vera rasulti for some of the prescribed designs which did not 
apparently agree irtth theoryf 4part from soma confusion, the effects of this 
wfere largaly beneficial, since the author was forced to spend a good d^l of 
time atfd effort trying^ to convince the students that the theory could be relied 
upon In general * 

Conclus Ipns ; 

Because of * the Sfflall slae.of the class on which the module was tested, 
and because of difficulties encountered with the operation and scheduling of 
the second axercise, conclusions about the af fectlveneas of the module as a 
taachlng tool must ba tantatlv^. Conttnuad use of the module in future 
terms is planned, however , and more definite conclusions should be available 
at a latex data. 

Happily it appeared by the end of the second exercise that the nntlone 
(I), (ill) and (tv) mentioned its the Intrndurrlon had been convened to niosr 
o£ tha studants (rao^-a eo^tXd h'^v^e Ha^n dwp^ th ( ii<), in a classroom 
Monte Carlo study. If mare tl©# Had av^ilableV In ::id<^-« t Ion , th^ 
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A COMIT MODULE ONfA TOPIC 
FEOM ADVANCE CALCt^US 

Bev Marghman 
Department tff Applied tothmatlcs 



Abatraat g This Is a report on mn^cpertoent>^eonduated with ' 
thf^e sucaeaslve second year calculus classas» In which part 
of each clasi was taught the concept of urilfoM convergence 
of a sequence of functions by an Interactive COMIT modules r 
while the remainder were given lectures In the traditional ^ 
mannar. An outline of tSe teaching techS In the* 

module is followed by a comparison of the perfo.rmances of * 
the two groups on a pre-teat^ post^testp mld^term, and firial 
esOTi* Finally^ an attempt Is made to evaluate the sl^lficanee 
of any differences In the above reaulte's and to assess the 
assets and liabilities of computer-aided teaching In general* 

Introduction * 

Thia project was very much a joint effort of myself and L* J* Makela 
then a graduate student in the Department of Computer Science. 
Basically j I developed the course content, while he took charge of the 
programmlngp although there was much interaction at all stages* Since 
details of the software are Included in his master's thesis [l]^ I 
would refer anyone interested in the computing aspects of the module's 
development to that source. In this report , I'll generallr stick to 
a discussion of the teaching techniques we utilized. 

Our principal aims were threefold. First, we wanted to see if the 
graphics capabilities and interactive nature of the COMIT facilities 
could be used effectively to convey the concept of unlfona convergence 
of a sequence of functions to second yea,r calculus students (ixreBpective 
of the effort and cost involved) ^ Secondly * we wanted to compare th%. 
performance^ both short-tem and long-term^ of the students who learned 
the topic through the COMIT module (approximately one-third of each group 
with thaC\#t tWe ,^CTalnder, . to see if there were any dFtectablp 
differences. Finally^ wg wished to rssps^, «s far pop«;ihlo. ^H** 
advantages and dtssrivsntages of ^hlo m^-^^""^ ^ p^^v^r^<.^ 
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The Modyle i ' ? 

The subject material of the ttedula, uniforo convergenefr df *a 
eequenoe of ftin&tlons« was chosen for a variety of reasobs^ It Is 

.moBt mmmily tntmTpwmt^S gmomBtttoBllyf and %fould thus utlllis the graphlee 
capabtlltiea of jCOMT j^lt^ls a .^ogtctBt J^^Aeh f reqUgntly gly 1 9 ^ gtudent s 
difficulty I and would, hoped> truly test the system as a teaeh'lJag 
device I finally , It Is about the right length. The first stage was ^ 
development of a set of bdtiavioural dbjectlves^ whiih, treak the topic 
down into distinct steps ^ each building on the previous ones until the 
'terminal objectives- are reached* These steps were tjhen further 

"jdisseeted, examples ealectedp and a flow chart designed for each* Several 
months of programing followed 1 and the module was ready for use early 
in 1977, (Por more details on all aspects ot the, structure, of the 
module J see [l].) * - • 

The main teaching technique used was a combination of allowing 
the students to display for th^^^lves the graphical behaviour of the" 
functions Involved while at the same time continuously soliciting . ' . 
answers to pertinent questions. In the following , one of ^he 
principal Ideas contained in the module is presented (al^ough'not 
verbatim), along with explanations of what the student might have done 
and seen in that portion of the module; hopefully , this will clarify »^ 
how the above^entloned technique was utiJlized"L (Anyone not Intereited* 
in the. actual content of the module can ignore the balance of this . 
section, as it is not essential to the remainder of the report,) 

A sequence of f unc t^ions , denoted f (x) , is Just a set of 

functions of a variable x ; one for each value n'^ 1,2^3, . . 

For example, cdnsider the sequence f (x) - x*^ , several tarras of which 

= - . n * 

are sho\m in Figure 1. Note that each term of the sequence is a 
single function of x . 




Tlgyre 2 



In the COICT modula, the atudent^^ 
sQuld chaoia to aee' any cams 
daslredp but adoh was ' suparlmpoaed 
on the pravlaus graphi * with the 
latest displayed In bright white 
and the fo^sr eholeas dlmed to 
a pfle green « Thus a studant who 
^g-had asked. In turnp for tams 
a - I,2p3i4,7,10 and 13 on the 
Interval [-1,1,1*1] would , in 
the and, see Figure 2 displayed 
on the screan, with the graph of 
i^^ix) displayed moat brightly. 
(Hotel To facilitate the flt,^ 
the vertical scale in this figure 
has baan compressed^ 



This aKampie was then refused to illustrata the ^notion of point- 

^^e cotivergeQce r the sequence .f^(x) converges p^dLntwlse at x ^ 

If the sequetica oT real nimibers f . (x f^(x ), f^Cx 

1 o 2 o 3 o 



approaches a certain valua as 
n 



f Ck) ^ % 
n 

111 
2* V $' 



gpts larger . Fnr example ^ i 5 

1 ^ 1 ,1,2 1,3 

, we gar tha sequanra l:^-) , . - . , 
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1=.- 



^^rge* > (When th^s happens, we say the flaqumea has a Itolt and wrltep 



for example i ito — 0*) Qri th^ other harid. If ve choos€ x ^ 

/we get (-1):* (-!)■» CrDVi or. -1,1,^1^ i , . ^lehjoes not "^^^ 

; kpproEch ^ay particular vaiue as gets largtr. A ttemant 's thought 
^ will CQQVlQse you that t|^s ^squanQe irtll only have a 'limit for 

^;&4^4i^;j^^aiue^ 

- so that^ approaohea 0 as gets large, or n ^ 1 , ^Iph gives 
the eequence 1^1,1, ife say^ then that the sequence i^Cx) - k" 

has linlt funatlon * 



f(x) = 



0 If JxJ < 1 , ... - 

1 If X ^ I . 

We again utlllzad graphics to 

illustrate this in the COHIT 
s 

taodule^ the convergent 
sequeAces for x = ^ ^ and 
K ^ - ^ j for efimple, are 
displayed as the vertical 
rows of dots in Figure 3, It 
Is clear that they approach 
zero, while x ^ --1, say, 
^oscillates batwaen 1 and ^1* 
(Heres 'approach zero' means 
the dots get arbitrarily close 
to tha K-axla as n ^ 



Figure 3 

Once the concept of polntwisa convergence had Been presantadj the 
student was allowed to 'play- with several^phar axamplee of aaquencep, 
using the graphics capabilities of tha systam to aaelst In finding for 
which values of x each saquence converged , and to what limit 
function f(x)» The student's grasp of the material was constantly 
monitored by a variety of types of questions (including some multiple 
choice), with iOTnediate fpedbaek giving the proper re^a^onlng whan p^rr>r^ 
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vera ffiad©. " 

It should be pointed out thmt the abave la a. simplification of th% 
aotual Mtsrlal -presented (fnth^atical rlgoum not being the object here 
tha kiM ' was /slnply to d^onstrate that the Ideas eould be, handled 
graphically, and to give a hint of how this was done . CComplete flew 
charts of actual material are contained In [l]*) 

Structure ofi. the ^pertoent i £^ . 

From each^ of three different classes of students In Hath 230B 
(Advanced Calculus), w4 selected ten students to use the module by first 
ranking thaoa according to their Hath 230A grades, then selecting every 
* third student; the r^oalnder of each group attended the usual two 
lecturM on this topic, all being given basically the sme two lectures 
by the author. All the students were given, unannounced, a pre-test 
just prior to the ^cperlment (to measure their background In the 
relevant area), and a post--test, ^mediately following, to measure their 
grasp of the atopic at that point. In addition, grades on the relevant 
questions on mid-^term (except for group" 2, whetfe no mid— term was given) 
and final ^ralnation were recorded for eagh student, to serve as a 
measure of long-term ratention of the material, although It should be 
noted that they are probably not very reliable indicators of any effect 
q£ the module or lectures encountered initially, since by that time 
many other factors will have come into play, 

"^e students who used the module wer^^ given a set of notes which 
roughly paralleled the material in the^^dule, except^the Interactive 
portions* These same notes ware used as a basis for the lectures given 
to the reioalndar of each group, in hopes that all students would be 
^Kposed to more or less the** same material, ^ ^ 

Statistical Analysis ; 

I wish to thank G. W, Bennett of the Departm^nr of 9i-i^t±sfi r ^ '^r m 
summary which comprlsag the balanrp fhla ^^^tio^--; f^*-«-h<-' 
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ana^f^lsv^may be dbtmlned from hia. Data used a^e the aeorealbn the above- 
Qsntlanad teats and exama, converted to pareentages* Hiroughout the 
following,. PRE and POST refer to pra-teat^nd post-test gradeaV 
respeetivtly, COMIT and NON-COMIT rsferto the portloaa of^%ach group 
using ths ffipduls and attending lectures, respectively i and Tl, T2, T3j 
^,^gnd T^ refer . to pra-testp^ poat-ie^ ^ 
grades, reepectltrely . . ^ 

Table ! illustrates the perfdrmaneas of COMIT and KON-COMIT on the 
pre-tast and post-test for each of the three groups r Tha flguras in 
brackets Indlcata the number enpected in that call under the hypothesis 
that there la no relationship between COMIT and POST > PRE. ^ In all* three 
^ groups , the figures are consistent with this hypptheslsi that is^ any 
differences are well within the allowable error* ^ 

An analyais of variance on -£n(grade) was done as a nested 
factorial with main factors COMIT, NON-C0MIT| Tl, T2, T3, T4p and 
students as a factor nested within the COMIT factor. This analysis 
shove a significant time effect for Groups 1 md 3, but with no 
significant differences between COMIT and NON-COMIT Insofar as thalr 
patterns go. In Group 2^ thare were no significant effects, although 
the error terms were larga enough to make dlffaretices difficult to 
detect. 

Table 2 gives the means of grades on the various tests for each 
group , 

In sunsna^i (i) there is no evidence that COMIT versus NON-COMIT 
is related Co the fraction of students with POST > PRE; (11) there is 
soma evidence that over time, the students learn. In that T3 is 
greater than Tl and T2, although again^ chare is no evidence that 
COMIT students behave any differently from NON--COMIT students in thtft 
raspect . 

It is ImpOTtanc to not^ rhAt f-h^ v^rioiis m;=5rks measufa pe^r formrir^r^ ^ 
under different conditions in ^h^^- ti onw o-^. 
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Tabjg 1: ■ ^npariisn of CfflilT mi NON-cm Studenta Resulti on Pre-tist lad Post-test. 
Thrii igpipate groups of students wire involvid, 





GEOUP 1 


GROUJ^ 2 


GSODP 3 


Tl ■ 


T2 


T3 


T4 


n 


T2 


Ik 


Tl 


' T2 


13 


T4 


COMIT 


.729 


.82a 


.821 


J80 ■ 




.594 


,630 


.538 


.713 


.787 


.480 


NON-COMIT 


.607 


.653 


.869 


,663 


.632 


.639 - 


=. 1 


.479 


.686 


,71? 


'.414 


mmx 


This difference Is tnoitly T3 
iiprovefflent over Tl and 12* 


No significant tiii\ 
pattirti. 


\ The bulk is due to Ette^jasdy 
%ii fU T2*T3 and ihe 
sudden fill T3 ^ T4, although 
a signlficiiit T2?T1 coniponenE 
does not ixlsti 



Comparison of Mean Grades for COMIT and NO^^OTT Students on Pre-Ces^ (Tl), Post-test (T2), 
Mid=tirii Test (T3) and Final Exai (T4). 
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laaterldli .whereas T3 1© only. as a component of about half the ooursei 
idilla T4 is as^a CQmponant of the whole courBe. Study preferences 
may InfluenQe T3 and T4* ^ 

• Conclusions i . , 

^^^^^^^"^^^^ 

, teaching deyica for ^-mathematical fflaterial*was fiilly achieved^ afld with, 
3 great suceeas'. Aside from, some complaints about the respoase .tliiis pf 
tha computer,^ over whleh we had no control^ student reactlofi to -the 
module _ was very favourable « The following, is a selection df more or 
less typical quotaa from the writtan comments handed in on completion 
of tha module: . , * 

"I feel that seeing the graphs and being able to experlmant with 
vatlouff n'a and k'^ greatly helped me undarstand the concept of 
uniform convergence, # Another advantaga of this teaching 
' , method is that it requiras active participation of the students 

where In a claas, full attention Is not always given," 

1 was foroad to respond to questions all the time and, thus 
take part in what was going on.*-." 

\ 

"The graphical aspect certainly added to the comprehension..." 

"Being able to go at your own pace and having things repeated 

when you didn't catch a concept was helpful. The usu of examples 

with immediate feedback and explanations of how to do the questions 
was good also/' ^ 

"The advantage vas that T had tn th^ alert all the time 

and thus T learn^H mnr^? about the topi*". In rl^isq T normally V^^^ 
sleepy sometltDe© . The Idea of asking questl'^ns after ea<^h 

section was a good '^ne. It t^'^t^'^ th** priMp*^*- * pK^mi-v 
r^fisln th^ workv*' 

o 
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: Some of the students thought even more examplep should have beeci*, ' 
/iacluded; some would have preferred two one-hour seaslone rather ^ 
than oKe .two^hout, as their atttotlon flagged tbrarda the end* It 
should aiao bfr pointed out that the novelty of the situation probably 
eontrlbutad somewhat to their ^enchusl^am, 1 f eel "^quite strongly, 
*^^howavatY that^tha Ime^^ 

of* computer-aided Instruction! we don't ever leattt mueh by listening 
to someone talk about. something I we learn by trying things out, making 
etrorpj correcting for them» and trying figaln. It Is In this asptct 
that an Intaractlve sy&tem excels, ... 

Regarding Our secorid alms that of comparing the performances of 
COMIT versus NpN-COMIT students ^ the s^tatistlcal results speak for 
themselves* &ny differences are well within allowable error. The 
post^test grades^ which are certainly the measures most closely 
related to the material presented in the module, were obtained on a 
ten-minute qulE^ and it could be questioned whether such a quiz could 
test anything in depth, NevarthelesSf it was designed to teat 
whether their knowledge was at a level acceptable for that topic in 
that particular course, and as such represents as eKtensive a 
perfbrTnance test as would ever be required. Keeping this In mind, we 
conclude that using COMIT did not produce perceptibly better 
performance (at least as we measure It) from the COMIT etudents over 
the NON-COMIT students^ Whether that means they did or did not under-- 
stand the eoncepts any better is qul'tfe another question I 

Our third and final aim was to assess some of the advantages and 
disadvantages of the medluni in general. The obvious ones have already 
been mentionedi the student sets the pace at which the material is 
covered; the constant stimulti^ pr^^^ided bv ?^he InrfractinTi with the 
terminal keeps internet up^ and accelerates assitnUation of the 
concepts; the explannfionp given aft^r ^ach f^rror ri"f>^if^e^ ^ H^gr^^ 
'personal' attention impossible in a lerture whet-p the^-e ^re more than 
half a dozen stud'^n^^^ i" fr^-e fhar ^^''ep♦■«=' ''9- ^> ^^^^ r^<^f:1^7e 
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X hope theaa few tetoples hjLve convtaced you of the great importaoce" 
visual aids to ths teachlhg of ^eolp^. COfflCT promised to maka^'thia 
naterlal available in an automated interactive system. * . .^ 

After some Initial planning sessions , during which the aims of my seg^ 

^^^^^^^^^meiat^^ere^ e^ 



diagrams 1 usually draw on tlie blackboard had to be produced^as colour tranSf^ 
parencies for COfflT. Hils was a plus^ because I Me subsequently able to 
use some of these diagr^os in a corresponduce version of Biology 232, But 
I soon became horrified by the massive Investmmt of time. whlcKf the produce 
tkon^ of this segment was ^vlously going to Mtail,* I did not keep a record 
of the hours 1 spent on it, but I taiow their n^ber was excessive. The 
parallel investorat of time on the part of the COMIT programier was* I fcnow, 
larger by an order of magnitude than my qwn. After a protracted period of 
developmtot dufing which inntmarable changes ud corrections had to be made, 
thasSystem became operational, at least in thiory* Mother problem surfaced 
at this point.^ The computer had to be programed to cope with all possible 
Incorrect answers, as well as with esaentially correct answers which had 
been misspelled « This called for additional hours of programniQ| and con^ 
sultations*. After a further extended period of fine- tun Jjigs it became pos-- 
sible to sit at the console and run through the module. 

I had originally requested that a sound^pracfc^be incorporated in the 
module, I didn't press the matter too hard, and in the event* the rfound 
track did not materialize* 

I regretted this omissiori, because 1 believe that the information I 
try to present is better accepted when received by more than one of the 
senses. The mycology module in its final form was entirely visual. The 
students have to stare at a T/V screen, at very close ranges for an hour 
or more, ^is probably bothered tham far less than It did me, since they 
have been exposed to T/V from birth. 

Because of certain unavoidabla delays in putting the final touches to 
the COMIT modi^lej the topic had already been covered in the regular lectui-** 
fprmat ^Aen the time came for 20 volunteers from among the one hundred bbc 
ond y^r students to do the modules, I announced that there would be a 
class test on the topic the following week. This gav^ non-COMIT sfndentp 
a chance to revl^** tha ^opl/" fr^^^ rh^.-fr r<=*stiiis>- f^ext and '^ther mJ5f*a»in^ 
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Ihe teit ahowkd ttmt mlthough seoras ©f the students taking the COOTT med^e 

were, on. averagas slightly higher th^ those of tha rast of the class, the 
dlf far^ea was not aignif leant* 

I asked for wrlttan cofltaCTta from the Gfflax stddMts. Steea the COICT 

J r fiact on my regular pre§totations« I need not have worried* Their g^eral 
tenor' was reassuring. Maay students ^olalmiBd to hwe enjoyed the module,j.^ 
^d to have found It a good method of ravlstog material, ^ but most of them 
alsa^JLnslsted that It e0uld_npt raplaca^ the normaT leeturas > ' 

But perhaps I should let the ^students speak for themsalves. Here are 
some represratetlve comets: 

excallent attempt at using sophisticated technology as a teaching 
aid it was very wall organized look forward to using 

teaching aids of this sort (and this quality) in the future you 
^ = were able to go at your own speed "... served as an eKcel lent review 

I intand to use the computar as a way to review for the exam ..." 
"... it was very effective in reinforcing the basic characteris'tica of the 
Aacomycetes due to the inmedlacy of Interacting with the computer, and the 
thoughtful manner in which the segnent was organized and illuBtrated. . 
'*Aa a supplCTent to lectures it was worthwhile. It helped to clarify and 
condense the lecture material.... It was a good idea to Involve the students 
in answer ing questions t since I was receiving immediate feedback^ I fplt 
' like I was gettijig per^nal at taction but if there was something I didn't 
understand^ I couldn- t ask the computw to explain* The slides were goodj 
although not as clear as when projected. "... You were unable to return 
to a previous part of the module if you found you had not grasped the con^ 
cept f^iy. .." "Even with the questions the computer is much like reading 
a text- book*. .""**, Perhaps if a soimd track had been provided, it would ^ 
have helped,.." "... the lack of an audio stimulus Ecpde it perhaps a little 
boring..." ",., Though the compufcer method was in t'^^e^ting^ enough, I feit 
I preferred the lectures and slidea*.." ". , * The pfog^anroae ^*?as vary Imper- 
sonal ... the colours on the screen were often\very bright, and after raad- 
ing it for tw hoifrs your eyeit became very tirid . . , larf vires Are prefer- 
able.^^" A good professor brings a, lot more to a course than this pro 
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grama did. He brings ih^r est ing toecdotea, vitality » lining proof that 
somebody reSliy Btudlsa all this stuff, as well as a lot of tasnmiem that/ 
the computer didn't' have, #• * 

ny own feelings after the experJamt eaft be expressed as^foilowsi ^ , 

(X) 'I now realize ^ery clearly Jttiit it would be enormously ^peflsive in 

even one professor for one, couree. i 
(2) Perhaps eves more ^portantlyp theie is still no substitute for the 
himM elCTerft in teachtog, A , good professor can communicate enthusi- 
asm a way that ^y computer would fJ^d difficiilt to emulate. In ^ 
addition, the nrofessor can imediately handle all kinda of red herrings* 
offbeat but interesting questions and backtrackings, and he ean tespirod 
to the mood of a class or individual to a more flexible way than If ; 
possible even for the most elaborately programed Mchine, (This is not 
:^ ;to say that he always does') 
. fi My general conclusion is th#t computer assisted inatruction can be a 
useful additional resource, but that it is not yet. time for the professor 
to quit the classroom forever* Only internal motivation can make a student 
learn and retain information and ideas. I believe he Is still most likely 
to contract that mptivation from another humm being, 

% 



THE POTENTIAL USE OF COMIT IN THE 
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Abstract : Two "imder graduate student projeeta were undertaken 
, on^^^KET aimed at. presenting many variables assoeiated witfi 
' ; /Kifiaan gait. The goals were ft display the outline of the leg 
alodg :^%ttc0ther dlagnoitle variiblBi^^uch^M mu¥^#^^ aeti'^ty ^ " 
(Qffi) s kinematles kinetic* and energy^ calculations # The pror 
jects were partially succeeaful in demDnatrating possible 
' potential of the COMIT aystWi'as a teaching and diagnostic"'"' 
tool. ^ ^ 

Introduction t ^ ^ ^ 

A. complete analytical description of one stride of gait requires 
twenty or ttore tltae domain plots- These would include ttoe histories o 
kinematics (trajectories of mass centres * angular velocities of limb 
segments i accelerations of joints, etc*)* kinetics (reaction forces at 
the ground and between the joints, muscle moments, gravitational forces 
etc.), energetics (potential and^lnetlc energies of se^ents, ener^ 
generation^ and abscJrptlon by. muscles, etc*) and muscle activity (as 
indicated by its alectromyogram) ^ It is an extremely difficult. problem 
to agsea^ the interaction of a fraction of these variables in nomal 
gait, and even more complex to irftegrate them to assess patholo^cal 
locomotion. It therefore appeared that COMIT had the potential of pre^ 
sentlng an Integrated picture of many of these variables and of seeing 
their Influence in time. 

Studenr Projects 

Two senior undergraduate research projects were directed to the 
development pf user programs for the assessment of himan gait. Data 
routinely obtained from the Gait Analysis Laboratory In the Department 
of KlnealoXogy ware used. The aim of the two projects was the same^- 
preaant to the user a flexible display w1 f h which he could I'Upract anH 
see the **cause *>nH pffpcf" of thp forces and mu«c1«' tSv^ ■ ^ <- * 
ga l 



The difference in the pKijects was in the mode of data entry* The 
first was given the coordinates of each li^ sepient from which a '^stlck'' 
dlagtim'of the leg could be generated to represent the body position « 
evei^ f33 m* ^ An algprlthm^waa then used to'^ genei^ate the contour of the 

i.leg^t^M^^posifel©n*.^JChe'Mecond»*app^ 

^uscle outlines via a light pen tracing of .th%^lrie f raie toage as seen 

f* n the COMIT terminal « On^ toe leg joutline^as generated , by either 
4:echnijque, the outline of -the^^jor nmscle groupe was generated ^and 
their activity .was presented two different ways i a 32 intensity level 
colour code was used to grade actiLvity trra tf^^to lOOZ, or the % activity 
could be written alongsJLde ea£h muscle. , Thm user could then call up the 
leg outline for any point in the gait cycle, insert the muscle_activlt3^ 
and then examlnp the position of the limb at successive points in time 
to see the effect of the muscle activity. A second aim was to display 
qiiantltatlve measures such as reaction force vectors , energy levels, etc. 

Success of Projects 

The first goalj as descALbed, was achieved successfully, but with 
some limitations to the user. The turn around time between Instructions 
and display was sometimes delayed so^ it was difficult to assess rapidly 
changing events. The second aim was not attempted because of the time 
and effort required to achieve the first goal. 

A logistic problem that sevarely limited the potential of COMIT was 
the use of cine film as a data base. There was no ready way" to convert 
the cine data to TV so that it could be displayed on the COMIT terminals. 

Conclusions 

The project was successful to the extent that it demonstrated a 
potentially valuable area for the COMIT system* A considerable amount 
of additional pragTEtsaiIng was ne^e^s^^rv to rtgaH m pt-nperly Interactive 
system that w;5s usef^O for f^^aching and clinical d-i agnosia 
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Abstract I CQ^uter lee HQekey praetice^was developed at the 'Unlver^ 
' Asity of Watarlpp Iji order to preaeat the coach's systems to, the. 
. - players Un a-nmch more 'cdnttolled adaldamlc sejttliig th^ te^^vall^ble- < 
Awipg PMcCice on the_lce^. Jhe^objectiyes of the cpmpufia^EpacWc 
wrei ^Wb allS? pl^era '^tife^ to th^R^out the ^steioB^^M^^lscUS^ ^ 
alternatives with the coach ^ to give the cbach a documented evalua^ 
tibn of how well vthe players knew the materiali - and to enable new 
material to be thoroughly taught and understbod before going on the 
ice. ■ ' \'; " ^ 

' The results of thls'sroject were veiy encburaging to the^^ ' 
University of Waterloo Hockey team placers and coach, Thm idea is 
definitely a valuable one whlefi'^ cbu]^^i# adopted in many other sports 
as well. 

In recenf years^ coaching the game of ice hockey has taken a very 
noticeable change towards a much more structured game. This attitude has 
been given a great deal of credibility with the eMrgence of such people 
as Fred Shero, Bob Pulford and Roger Nellson in the ranks of NHL coachas, 
!^ese men all believe very strongly in a disciplined "system" approach to 
hockey where all players have basic responsibilities in almost all situa- 
tions that may arise. . 

Wh^f^a coach attests to implement these sya terns, he finds that he 
requires nmch more ice time than was used in the traditional approach. 
The availability of Ice time is at a premiimi in almost all locations, 
"nils has forced coaches into mny alternative methods of presenting their 
material to their teaM and led to the developmant of the hockey coaching 
TOdule using COHTT at the University of Waterloo. 

This COHIT module wag capable of reproducing the various ir^ hockev 
systems in a Mnner that allowed players of the Utiiv^rsitv ^f u^terlon 
Varsity Hockey Team to view them and to regpond to a series of quest Ions 
based on specific assiinments designated by the coa^h. The prnutR^ wa.^ 
designed to allow each player maximtiTn tiwM fn ^^uHv ^^^^ In ^jn^^^i^^' 

and. also to provide the coach with a d^'^^O^^ rr^nf ' »t,<^ pi^^v^^'- 

responses to the ^^uest^^^s h^ ^ngw^f'^^ 
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a = ^ .. = . * - ' * ' 

ftDiare are May mdvintagee of h«lag a program of this nature avail- * # 
able to a hockey team. Valuable lea tl^e. was notr^waated in a ^ime-conaim*- 
ing taaehing proeeaa of the syatem. Players .ware taugl^t using* a blaeldsoard 
Vafid th^ tested pn the ccpputer** The players had an unMmited time, period 
|^f^^^£^^ respond to quest ions v^^^s all^ed^each player to I* 

atu^ the^vptoblenr fthdrbu^ly at his 'dwn speij before having to respondlSThe - 
positions of all of thejlayers of boith 'teams were readily visible on the * 
, acrean and he could see a covoplete system in^ one look, something he^caa not ^ 
^^i^ee ^ii^^ The system allowed the 

player to make one Inoortect response to question 

showlAg hlm ,^ 

the correqt respdns^^ This feature meant that the player had to think out 
,hls replies base^ on^^^he tacwledge of the previous wrong answer* 



Th^ author wa^>responsible fpr putting all the hockey .technical data 
' on the computer. Dr. Moore and his computer associates spent coimtless 
hours developing the con^uter program required^ so that all the various 
ays terns cotd.d be included. The player sat down at the terndnal and Intro- 
^Aic^d himself by typing, his nama on a conventional typewrite^ keyBoard, 
^e player was then asked whaf position he wanted to study* Upon replying, 
the player was then asked what area he wanted to study. He had the follow^ 
Ing choices I 

k) J^echeckiflg * ^ ' . 

. ' * a) i^^backche eking / =^ , 

^ c) breakout patterns 
d) power plays 
a) penalty killing 

f) miscellaneous - face=off 

special playa 

g) all of the above 

When the player indicated what area or areas he wanted to study, hp 
was then presented with ^ pl^n ^^Ipv of the rink on the s^r^t^^n as sVinwri in 

th^ Figures. Th^ sef-Up on fh^ ^rrp^n qhow#d the player fh^ former inn ^irh 
the off^ns© In one colour and fh^ H^fense in ^no^h^r . Thp pn^ir^fir^ w^iv: 
fttudying thOT began hlinU (f^n AnH nff ) on ^cr^^n fv»fe ^^ ^v^t hr> 

exactly where h# wns rm thp Irp mwffBCi^. qu^pf^on vOtiIH fh^n ^rpo-^r 

an the flrro^n st f^p nf the rink '^utl'^ne. T^^- plo»pr fhen h ' 

p<^1nt with 4 Mghi- p^n ^ '* th# nl^f^p " . ♦v>5.av.* 1 1 ' 
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Q»ve* If he waS^Meetj an erit^stateMnt appeAed eleag with all of 
"- _ ' i ^ ^ ^ ? |« > 

thm other players correeti^vements so chat t^e pIAjer could see his.^ 

isD^raante In r#laclon to^H^ teaffl^ttatfes* Eoves* If^e Ineorrecii^^^ 

he vouid be toti so and asked to try again. If he firo^ Buceeededt the 



■ aSove (ebrrw t J display *^Md foU If Se^^M .agaj^jincorr 

player would be told so and thia thm feortect ^JpveEenta wbuld appear* -^e 
player could study the screen for as long as he w^te^dj \when he was 
ready to proceed, he sl^ly pressed "enter" md the neKt?}itep would con- 
front h^« ttis^procedure was followed for all ^|t^uestio^^ln all syateais, 
Whe^ the player was finished, a record then appeired on the screen, nils 
showed his Tesponses tb each questibnj whether ri^t , wrohg^ or skipped , 
and then a percentage right and wrong for all questions* 

, V , \ nils record was also available to the coach in the fon^Of a print- 

out* The print-out told the' coach whb had taken pftrt in theJ*progr^> and 
^ how well he had done in each area* This turned out to be a very^veluable. 
asset to the coach. After the -player had co^leted ^e £est on his own 
position, he was then encouraged to try the test^ for all the other team 
positions as well. 

The players could attend the progrwi at any free period during the 
day and could make very constructive use of free time^# 

The rtesults of this project were very encouraging. All the basic 
objectives %er^ rmt and then some « It was foimd that the players could 
easily operate the program and did not feel out of place with it. The 
^ progVffln initiated a great deal of discuaalon between the players and the 
coach, Us^lly this was precipitated by incorrect responses to various 
questions. This type of dialogue is often very difficult to initiate In 
a normal practice or game setting and turned out to be a major positive 
aspect of the entire program. The fact that players had to come up with 
specific answers to each question thoroughly tested their knowledge of 
the various systems and supplied the ca^ch th these resiilfs. Thm r^^Mlt 
Ing discussion made th^ players murh more f^^^re th^ ^yftr^ms anH 

thus made the hockey f'luh a Hert^r t^am. 

When th^ pi rg w^r ^ 4 n t- ^ ndu^ ^'1 ta rhi^ cyr * f^^^ f#am*g 1 s^gu^ 
record was 0 wln^ And 7 losses ^ft^r f^omr^^'^^fi ^gain^f f^ams thaf w^tf- not 
Ch# rl«»s8 le^gi5«' Tn fhp n^vf 11 c»-ifw?e7, f-^e '^^n ^ gam^ and 

*■ < #d 5 -itisf ffimirh m^fn^T i nr romp e f i -l T ' ' - , r - - » 1 * f ■ ' - .sp < i ^.t. - ^ 

ERIC 64 



the QO&Qh and tK^ playerp was due in a large part to the team being ax*, 
posid to this co^uter hofe^ey prsctice. 

The ©nly jmioT ni^tlve eoament that can be associated with this 
project was the ' treoendoua raoimt of ti'me required to get the aystem oper^^ 
4iattq^al *-^-niis^Would-be4^ 
the gromdyork^ laid in this endeavour, i ' 

The author wishes to e^'rass his slrfcere appreciation to Dr, J.B. Moote 
and his associates for their untir^g work In developing the system so 
ttat the diversity of Waterloo Warrior Hockey team could take part In 



this project* ^ , I W 
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Fl gy i r ' ^8^1 What Rlayer Vouid •^jSe on ithe Screen Ti • i ■ ■ 



Question 
.#.QFC1 



■ .6" » 
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Position 
Bllnlittg) 



Playing RW 
Wheri tshourd'. ybg 



Explanit ion 




Seslng the question wtth^ 
the RW ^oittiol^ blinking 
on and off^ the P layer 
would now take the light 
pen and indicate where he 
thinki he should go^ now'^ 
that the puck has gone be^ 
hind^tha net to 'the other 
def eaceftjad^^* j \^ ^ ^ - 

I f , t]ie p 1 aV^ r Te$pon'd#d 
Incorrectly the fol Toitf^ng 
wou 1 d apped r . 



The player would now 
repeat the original - 

process . 




Explanation: 
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i* CioTCyeet ; g /Bma ts of All Players are then Saovd ; 
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■ij -.■.■>■:■= i. 1. 'i . !. .t.. Ja' i .-i' ! .' 1-.,. ..V. ' ., ■ '^"-H- . = ^j. 



^'ISi iipiifttEDl teieifltfWtfti tas teUei toWe uie of te^saiDta \ 

.^rtii|,ttot hi lii I drift i i paUlebitlrtoW, 

PlDiliy, ha loeki fcr^ri At coiirt^ tkirfill ™ all of tte ^ 

Eo itf Eo lii£lo4i leii of tteii iittoia this fiUi f^I eolj wiih^thg toinUy 
vift |oia| to ritilii i0¥ of tbi loftvare froi tlii projiofeto provldi ill 
die lEndsiti ktl- UUM iwi ri^iv capability If not tkmh tk Mispytirliii 
Init^uctleail tsliviiloti tUu via rtindard 1 hatdvifi* 
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Atltiact : ^TMi bfiif pipar reviei^! our a)|erienc8 of CflHIt for in 
[ntwductOMrifay tote^ tie Hiitoiy of Art and csnclyfe that 
tte uiefy] ^ieElon to thf ^ect is rehtively llilteijl , 



^^^^ 




Fto Wi 111 ii a mm in thi hi^toi^ of art whieli introdyc^s ny- ' 
iiiiti to the ^iktlngi iculptura and architecture of the him world froro 
mwtit Sfiici to lodem tiias, The eouri^ stresses the fact that mx\% A 
in fefliet ttiHTiQceiipitioni of their 'eppch. Statats ire thirefori e)$eC| 
tid ^0 biOTelfaliar i^ith the ^ . 

tetiW4Tt. "iiylre^iquirid to ^ccpiie ft works, to be tble to flici 
tliiffl liiitdricSif mimM loMthi^^eiF partieulir mS%i. ' 
^ M an expefiiwt we fed 200 illdes intoVtlie Iput^terMnils >pd tr , 
rtiwlnp for approriiitely ?0 mim. ' taa prpims of nproitlon 
' llidlitelf feaciHi indent. Jfie tenniiiils reproduce sculpture id arcMta^ ^ ^ 
;'tijri i^ltti m icceptiie de|rf? of icfuricy; colour can^imin close to 
Aw yid fine details iWmx f^santiih ^fprodoctlons of paintiup f'a^ ^ ' 

^^owi, hs^iiever; tbl properWiour balanbe iften iiiipo^^'iblg tn ' 
ieftlivg ind thi^ualit^^of ih WkMhn 
f ^ In pm\ the ^tudenti krt itHnter^Miii^ ■ind lovel t^r- 
Will ^telare inWtible fTaitratinpv-f rtars^ soie d[ \ki ^.ir.or. 
Thi cMtf diartick I km Pare of ^^i^ riiaf thoygh tac ttrmin.^U h,T! heen 

flfy C|ll i^d do^OCCnr t'V^f'-^ p/h|Aii}^ '"f nT'qgi'f-' i (;;.».4j; 



' ''F6r dflr puafpo^^.Cb6dks, slides md goo^^^miy photographs provide 



do juistlet- to the subtleties of art ; 'particularly of pai tod they . 

% ^ ; ^ ^ ^ . ^ ■ — . ■ ' . ' ' ^ - ^^^^^^^ ^ ^ * 

\ i ^ are* =spmairfimfe; rigid in the way tHfey have' 'to be used \cith clM^^* 

fc* Qi^-x^onclusion the^ Is thatf ^hd CMlTTproJ^^^ptfi 

-workable addition to ttaching methods in the Fine Attl|^ de|artment * 
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analytie TOthod ^to^i:^cond ytor togllah studepta in a taqutrad cours# 
* and it rjequ^iiai^l^anding 6n etudaot ability )^ between four muA ten 
hours of study, >Xt parm±ta;J? mora^tkor^th presWtatlon 'and' review, 
ef the lesson than is ^preaetitly avallable\iti any other form^ 

Structure of Moduli rxjft^ subject of 'the modulelis Malytic 
Critlcia© and ^prttJ^as fou?^ contexts - Einear, Setting, Imagarys '1 
Structure* Students may review within and across omtegories a4i^^^k 
addltionai intfotoatlpn at^^iny point_in "thfe lesson.^ Both voice rieord^ 
^In^^d V^ to ttech yeqwncas of the Wsson^and ^^ - 

thai stiidflft is required to respond to .poto^ throughout! records^ate 
rj^^to^of ail re'sppnses fTOm keyboard and light pen. ^ 

^ Asseasment - Throufho^t the leaaons student responsea jilicit 
fchor cpDBpentfs on the coCTactness wd cotopltftenesa of each response • 
ca all responses are recorded » the author^ean obtain a complete 
_dord of eadh st^^nt's performnce* This data can be made avail Ale 
cito the ^tudCTt^ fo^^alf-eva^^tfon and provide^ a ctmmulative data .base 
for sttb^equanl^auJfiuors to ^fcedlct s^^ant perfofgance. In aWlttonv ^ 
the COMiy ^ftdule h'aa ioioe m^que ii«ittory features which permit *he 
autho^to cheek, for as^aplei the time taken to respond. ©r the sequence- 
of answering questions, ^ ... i ' ' 

l^ -? Probletta -^amlcal, pedakoEl^al irisftcuctional - R^pbnaa 
5 t±wh ^^the tmit^ia critical - It imist tSl^lnstanfcaneouSj ^a&( as t as the 
studeat can writer draw or -type, tailure|'^f re^ warr ^ grJ^est rrMt- 
rat^ibns. Next were aifficultips In synchronizing ^udlo a^id ^ieiial^^ 
sighals^to link, the cwb refp^ses to studrat requests. Bo^^X thesa 
V^are resolvable^ by changfes rin^equipfflent * Results of student pefrfqmance 
'^ave^.baen high in coraparisons^ with coi^tror grbups in conventional 
>%ecture/t6^ft^al situa^ons* PajfsoMlljeeapQnea^^^i^e^ xac^e.d^^ 



I 



Lai sltua^ons « 

it and ra^awareneis of materials and metWods mc^re completl ^natl ,a^> 



a4ute ^Wtratiofr o%er technical dalayt to strong/faall^gs of/aocoppllsh^ 

ds mdre completl ^nart ,i 
previoua learning experience in i8olattofi\ Studfeots have not 'been 



1 



son 



isolated by the machin%", , The flueat^na; they now ask are acadgAc. ref 
pt>nsas to theJwoBk at^^hlgh level, A \ / / ■ 

Jha COHlT^nglish modul/uaes most of the i^Carr^ated devices ^f s^und 
^ pehj^keyboard, slide an® terminal displavln a lesson which, depei^Sq^ 

om If^uf to teft ho4jrs and 



on .the . student ' s intereHt and a' 




which forsns an IntPsral part of dur sacond-year cours 'g'A n.. sr 1 1 leal analys-fs. 
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^tom £iim butBmt/l^go\3^^^^ QOffibin^lpnfjof a lessott,^0t teat , 
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it is uncompromising in its insistence that each user meet; each of its* 
questions, puzzles or requests for knowledge and structure and it will 
not proceed on the happy assumption that the perspn sitting in front of 
ic actually does understand ^and declines to answer because the question 
Ls not of sufficient interest. 

-At the outset my purposes in COMIT were twofold; I sought a teaching 
'device which made no compromise" with the best academic standards of "ray ^ ' 
subject and which involved the student at each stage of the lesson more 
directly than the conventional lecture method can. It is not a question] 
of beliief but rather a raatter of fact that raodules of this kind raeet bo I 
conditions. Questions of their role vis a vis an instructor, how rauch <if 
this kind of instruction is optiraal, the deraands on academic resources /in<. 
their iraplementation, raatters of cost and the social and pedagogic research 
we d^irive are all, in the long run, peripheral. The project's value ^ies 
in its thoroughness and the ability to have students take charge of their 
own learning; Any raodule's flexibility, across and within disciplines, 
depends Only on the iraagination and skill of the authors and designers who 
create it. Not only in COMIT, but in other systeras already functioning 
in higher education, the only functioning adverb is not "how" or "whether'' 
but "when." 
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Appendix ; "the passage ased In the COMIT Eilgllsh module on 
Analytic Criticism Is shown low: 



"l^s^'^tched its back-gate behind my trembling stay. 
And the May month flaps its glad green leaves like Wings, 
Uelicate-tilm^.d as neiv-spun silk, wur the neighbours say, 
He was a man who used to notice such things?" 

IT it b^ in the dusk when, like an eyelid's soundless blink, 
.1 he ev£hing-hawk comes crossing the shades to alight 
Upon the wind-warped upland thorn, a gazer may think. 
To him this must have been a familiar sight." * 

' \Ll P*5? <*"«"ing some late night blackness, mothy and warm. 
When the hedgehog travels cautiously over the lawn. 
One may say, /He worked that stich innocent creatures should come 
But he couM do little for them; and now he is gone." to no harm. 

If when hearing that I have bfeh stilled at last, they stand at the i door. 
Watching the full-starred heavens that winter s^^^^^ .1 
Will this thought rise on those who will meet my face no more, ' 
He was one who had an eye for such mysteriesr 

And will any say when my bell of leaving is heard in the glooiii. 
And a crossing breeze cuts a pause in its outroUings, 
.fiill they rise Again, as they were a new bell's boom, • 
He hears it not now, but used to notice such things?" • 



REFLECTIONS ON A COMPUTERIZED MULTI-MEDIA 
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. Abstract: The development of a*COMIT module has involved a broad ; 

spectr^ of experiences. Initially the concepts presented sparked 
* visions of fascinating combinations of computer graphics, slides, ; 
tapes, films, student-computer interaction and many other potential 
./ "tools" to be utilized' in geographical education. The selection of 
a subject however, lead^ to a rapid revision of initial concepts. In 
addition^, the methodology of module development soon established the 
necessity for a much more detailed knowledge of the chosen subject. 
- The steps which had appeared relatively simple and straightforward, 
became complex and time consuming. Finally, the emergence, of a 
reasonably complete module permitted testing to begin and the problem 
of testing to coine to the fore. Attempting to draw co'nclusiot^s on 
. the 'basis of inadequate testing results yielded recommendations for 
Ji^he future. 

Initial Concg Et ^ 

A6 origii^liyiP^^^sented, the objective Computerized Multi-Media , 
Instructional Television was" to /combine educational television with computer 
assisted instruction and evaluate the educational capability of this 

marriage. * . , 

To a geographer with specializations in the fields of geomorphology - and 
remote sensing, the pottfential was fascinating. ^Imagine being able to incorpo 
rate in one unified module such diverse but interrelated teaching components 
as colour movies (video tapes) , colour slides, sequential images with appro- 
priate annotajU-op (letters, arrows, dashed lines, etc.) ^ dynamic computer 
graphics which lines could be made -to move across, the screen, letters 
could be/made to flash on and off to emphasize audio comments, and colours 
could/be used to distinguish the various segments being discussed) , a sonic 
pen/fwh'ich could be used by the student to indicate Ms or her selection In 

^sponse to a visual or spoken query) and audio commentary, overall (discussio 
^explanation, o*r query); Visions of colour movies showing waves breaking on 
a beach at nomnal speed and then in super slow motion, followed by graplj^cs 
illustrating the way in which water particles moved in a ".normal/' wave,/ then 



In a waive breaking on a beach, the whole backed by the sounds of breaking 
waves and a dlBcucslon of wave dynamics, and followed by a series of ques- 
tions to evaluate the students' comprehension of the factors and concepts In^^ 
volved.and of an almost infinite number of similar possibilities, were gea- ' 
erated. Enthusiasm ran high. 

Module Development ' 

Then the crucial question was posed; /given the need to tfest this ap- 
parently unlimited potentia^l system, wha/ small segment oT a course current- 
ly being given should be developed intp a COMIT module? 

From the many possibilities, a segment which seemed ideally suited to 
the techniqiie (as discussed abov^) , or a segment'^'l^ch formed a small, im- 
portant, but difficult to grasp, \>art. of the course, could be selected. 
Based on numerous factors, but primarily the difficulty experienced, by' 
students in understanding the concept and the consequent length of time 
spent^on ejcplainirlg it, the subject of parallax, as ysed ±ti remote sensitlg, ^ 
was chosen. V . 

Parallax is defined as: "The apparent displacement of the position of 
a. body with Tespect to a Reference point or s^steiii, caused by a shift in the 
point' of observation". - ' ^ y 

V Initially, the approach taken in attempting to set up a module was, 
in essence, to translate the lecture i^orm^at to/the COMIT format. A consid- 
erable number of weelcs later, weeks which involved pages and pages of writing 
.innumerable diagrams, and enlightening ^^i^^lons with the COMIT advisors, - 
a significant factor became evident the/^'al^i^hor" didn't know as much about 
parallax as he thought he did! 

This somewhat less than ear th-r shaking /discovery led to an intensive ^re- 
view of the literature on the subject. This in turn led to another discovery 
many other authors of texts and reference/ works, were unable to expl^n the 
poncept of parallax clearly and concisely, or in any event, had not. bothered 
td do so' in their works I 

, Howevet, an acceptable explanation/ was eventually formulated and the 

problem of developing thie module was again attacked. 

•' ■ ■ " / i V ^ ■ 

The first approach involved a spc/t on tlfe screen, a student, and his or 

her thumb. The student closed his left eye and held his thumb between his 

right eye and the screen such that it/ obscured the. spot (Figure 1 a) ; then, 



maintaining the dame position (le. not moving his head or his thumb), he 
closed his right eye ahd opened his left. At this point he could see the 
spot again an^ the thumb appeared to have shifted to the right of the spot 
(Figure 1 b). This apparent shlft^ in the position of the thumb with respect 
to the reference plolnt the screen, when viewed from two different points 
In space (the right eye ^lew and the left eye view); Is called parallax dis- 
placement (Figure I c). ^ ^ • 

Problems of relating this simple example to the geometry of a seqaentlal 
pair of air photos led to a number of revisions, and eventually, after a con- 
siderable length ^f timfi^to a somewhat different example Involving a tree, 
a pole, and a car moving along a highway * This produced a sequential set of 
Images which not only illustrated the apparent displacement of one body with 
respect to another and, in turn, both with respect to a reference point, but 
also permitted the utilization of a movie o]c ^id^o tap6 sequence which re^ 
lated the concept to a common eyery-day experl^ence (Figures 2 a,b,c ). 

It was possible to display the geometry o^f this situation on the' screen 
using slides; and also^ using the dynamic computer graphics capability to 
illustrate in a sequential format, the relationship between the angle of 
parallax (Figure 2) and the linear displacement^of the features oif th«r*l31^ge, 
le. linear parallax (P) . ' 1 I 

Throughout this developmental stage, it was^ necessary to keep in mind 
the necessity for interaction between the studenll and the "message" being 
presented on the terminal screen. A whole series! of questions had to be de- 
n vised (and answers provided) to lead the student to ai\ understanding of the 
concept being priBsented. A ntimber of incorrect angers had to be devised as 
well, (for each question) and a system of feed-back" included such that, if a 
student selected the Incorrect answer, he could request a review of the ma- 
terial, or a "hint", in order' for him tp satisfy €he requlremejits before he 
proceeded to the next step, ' . * 

Intermediate phases of the module involved measuring the apparent dis- 
placement (parallax) on the screen using scales Incorporated in the image 
(Figure 3)vand^in the final phases, the ^translation ol^thls example toj^the 
aerial phptograph and the geometry of paraliax measurement as a method o^ 
determining heJLghts of objects (Figure 4). , ( 

However, sln<:e this paper is not attempting to explajLn parallax^ but ^ ' 
rather to' evaluate^, the COM^T approach to explaining parallax^ no further^ . 
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Image 1 



Image 2 




Parallax of Top of Pole - + N2 t2 

Parallax of Bottom of ^o I e - + N2 62 - Absolute Parallax p 
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Figure 4 
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discussion actual module steps will be presented « 

Having d€?v^loped the module, theVext atep was tq Vest it oa th^ members 
of,.^ class who wet?e resppnslble for the. concepts involvjed. At this poir^t, - 
one, of the major disadvantages became apparent. The author, who at this po^nt 
at leasfe, should be assiuned to know the answers, ran through the completed / 
module on the terminal and determined that the time 'required was approxltoately 
2h hours. This was partly due to the fact that it was necessary to use a 
ioose-leaf binder containing all the illustrations and diagrams instead of 
having them, on the screen as previously propqsed. This discrepancy or problem 
yaa in part^tne .re^ult^ of the author being on aabbatical during this phase of 
the programme .^^ 

. • The time required io complete the module when combined with a class of 
120, obvi^oUsly involved a major logistics' problem; not only In terms oiE/com-- 
puter time itself ,Nbut al^o In terms of 'scheduling access to th^ limited 
number of terminals available. As a rejsultv it was decided to use a small 
volunteer class sample and have them arrange their own sched^lng. This 
proved to be another error. By the time the course had reached a stage in-, 
volving thiirus^ of the concept i it was determined thai; only a few of the 
students had .actually made appointments .and worked through the module. The 
resulting comments were of mihimal assistance in evaluating, the system* s 
capabiliti>y. , ^ ' - 

This leads to some conclusions with respect to Computerized ^ulti-Medla 
Instructional Televiaion as a method of teaching a concept; 

Conclusions * v, 

• ' • . . _ , V. - , •■ ■ , » - . 

• First, it does not appear to be ^ system which can be ^tllized to teach 
small components of a course, involCirig large numbers of students. Even 
assuming a relatively large number of terminals and access to these terminals 
over Extensive periods of time during a normal day , the 'computer time required 
and the problems of scheduling the use of the terminals would be excessive. 
Second, it is a system which demands a great many hours of input on the 
part of the author in order tro develops relatively simple module. This 
assumes ari even greatet^jou^er of hours of input pn the part 0f ^n assistant,* 
to programme the c^jju^ter aMi handle the technical aspects, especially 
video tapes, slidesT" audfo tapes and many of the other elements vhich ..p,rp- .' 
vide ^ch a fascinating potential, are utilized, '\ 
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Third,, an. author, or woyld-be author, should have of acquite a good * , . 

^ v^rKinjp ltnbwledge of computers and computer progtaamirlg. It is diifffciilt to . 

forM^e problems Involving question formatf, ansWer format, graphic developr 

f'^ ^ ' ' ' ■ ' ' . ■ • ' 

ment,, video, audio, ^and slide inclusion, etc. , without any backgrouiid knbW- /• 

■ ■ ..; ' ' ■ ' ■ - 

ledge in the fields ij 

Fourth, unless experienceid in COMIT module development , tt would, be 
advle^Jjfle for. an author to produce one or two trial modules before attempting 
a final effort. Familiari;fatlon with the problems associated with module ^" - 
development obtained in this trial period would permit the /authoi^ tip tfave 
a great deal of time in aelecting and planning segments of- his course to be 
presented in nodule; form. . ^ 

Fifth, the author should^ be fully fiamiliar with' the course segment or ; 
concept to be developed as a module. If. the author can combine this capa- 

blllty with thode discussed in three and four above,' develbptnent of COMIT 

a" 

modules should not be too difficult. ^ ^ 

■ ' x - y- . ' . ■ . ' ' ' f . . , •. ■ 

Sixth, the nature of ithe subject matter has a gmeat bearing on the use, 

development and effectiveness of the module format* Very difficult obn-* 

cepts requiring active faculty-student dialogue wo^d ngt appear' to be 

suitable in this context. . 

Seventh, in order to evaluate the effectiveness of a 6ioduIe , , a statis- 
t^ically valid clasQ sample should be selected, tbgether with a control^grdup 
subject ok the standard method, and the two groups upon completion of the 
coursei^^^^ment involved should writ^^an identical test. In ^addition, time 
expended by the students ii^ the two* methods should be talken ihto consideration. 
Finally, the opportunity for the one group to re-run the miodule if details 
hof the .concept were not clear, ghould be taken into account. • ' 

Eighth, if an author we^re to plan on using some, or all, of tl^Vayions 
audio/visual capabilities of the system, knowledge p*f; somfe of the basics of 
television programming such as story-board preparation, scenario writing, ^ 
video '"tricks"; etc. , would- seem to be advisable. i 

Future ' ■ '.. • "■ ' ' ■ _ \^ ' ' . 

Most^ of the. potential, which fascinated . this author when the programme 
was first discussed, was not realized in the development of the module dis- 
cussed here. The capabilities are still there, but it will r:equlre a dif-r-J ^ 
ferent programme to make effective use of them. ■ tn this context, a multi- 
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unit module designed to present a complete segment of a course would seem 
not only feasible,' .but also desirable. In Its Initial Implementation, It 
would not have the one-to-one, student/terminal Interaction, but wpUld be 
designed to complement rat he^: than supplement a faculty member , In a class- 
room* situation. However, Individual units, making up the larger module, 
could be utilized,, with appropriate visual or audio programmea, to provide . 
the students with a very effective review facility (using a Con^lt-type 
terminal) . . 

The above format could be developed for a full course, thus removing the 
repeti-tlve aspect of a professor's programme and allowing him or her much 
taore time for preparation, discussion, and interaction with the class - re- 
gardless of size. The^ length of each unit would be determined by the pro- 
portion of the lecture period assigned for discussion. 

Finally, this type of module format could easily be included in off- 
campus (remote lecture theatre), in-home computer terminal, or conventional 
television/ telephone, educational programmes. 
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LEARNING FROM COMIT: THE EDUCATIONAL IMPLICATIONS 

. ■ by „ ■ ; 

Christopher K. Knapper 
Teaching Resource Person 
' ' University of Waterloo • . 

Abstract : Experiences with the COMIT System of Computer-Assisted 
Learning are reviewed In relation to five evaluative criteria: effect 
on student learning, effects on student attitudes, effects on teachers 
Institutional effects , arid extra- Institutional effects . Conclusions 
are drawn concerning the possible future pedagogical role of computer 
assisted learning, systems. / 

The Impact of the computer on .contemporary society has been so great 
during the past two decades that there are few Individuals living In the 
Industrial nations whose dally lives remain untouched by this aspect of ^ 
modem technology. Education has of course been markedly affected by 
computers, especially with regard to administration and planning. Para- 
doxically, hovever, methods of teaching and learning within the educational 
system have been remarkably little Influenced by the computer in any 
direct sense ~ with the obvious exceptions . of the use of computers as 
tools for numerical computatign and as a means of teaching programming 
skills. This state of affairs is perhaps not as surprising as it may seem 
If we exainine historically the Impact on learning of instructional 
technology-- or Indeed the Impact of pedagogical Innovations in general. 
On the whole, teaching techniques have been remarkably resistant to change, 
andilt might plausibly be argued that no innovation has had any substantial 
impact on the way students learn - — at least? in the formal education 
system — since the invention of the printing press. 

COMIT is one of the most sophisticated systems of computer-assisted 
instruction. -As John Moore's Introduction to this volume describes, it 
combines the facilities of a powerful computer with a rich and versatile 
presentation mode that is capable of supplying moving colour pictures, 
complex graphics and sound. The student's method of responding 1^ also 
flexible, permitting communication by sonic pen or keyboard. This Is an 
awesome facility, and it is consequently of Immense Interest to examine 
in some detail the attempts that have boon mado to use the COMIT system and 
in particular, to assess the succoss of the system Irom au aducatlonal and 
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pedagogical standpoint. In this respect the precedinR reports from COMIT 
course developers have great relevance. ' 
Assessment Criteria: 

■ r r- . ' 

In attempting to evaluate COMIT, the question immediately arises of 

what yardsticks are to be used to judge the effectiveness of such an 

instructional system. I propose to use five criteria: Effects on student 

learning. Effects on student attitudes^ Effects on t ea cheers , J^fts-t4.1:jLiH.onal 

effects, and Extra-institutional effects. / 

(a) Student Learning . Jhere will be little disagreement amoW teachers 

that a principal aim of instruction is to facilitate student learning. 

Learning, h(iw€;ver, is not a unitary concept, and those resp^sible for the 

design of instruction ntust give careful consideration to the particular 

type and level of learning it is hoped to achieve. Bloom (1956)' in his 

well-known Taxonomy of Educational Objectives [1] lists six types of ^ 

dearning (see Table 1) and it is interesting to note that all six types are 

represented in the COMIT modules described in the pre.ceding papers. 



Table 1. Types of Learning (from B. S. Bloom, Taxonomy of Educational ' 
ObjectiveB , 1956) 



Knowledge 



Comprehension 



Application 
Analysis 



Synthesis 



Evaluation* 



of specifics 

of ways and means of dealing with specifics 
of fhe universals and abstractions in a field 

translation 
in te r p r e t a t ion 
extrapolation 

use of r;ules, methods, concepts 

of elements 

of relationships 

of organisational principles 

communicat ion 
planning 

derivation of a set of abstract^^lations 

internal evidence 
external criteria 



Of considerable Interest here are the ways used by the different module 
to achieve different learning ends. These range from drill-and-practico 
techniques and remedial instruction, as described by Dolnhoy la teach offen- 
sive line play in football, to fairly elaborate simulations of real-life 
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situatloYis where students are required, to apply the knowledge they have 

attained, achieve some synthesis, and evaluate the efficacy of theoretical 

notions in relation to the simulated (data, >A good example of the latter ^ 

approach is Thompson's programme to teacli survey san\pling, which' exploits 

a capacity in which the computer, excels (storing detailed information and 

arranging for its retrieval in a vtiriety of different formats) and which 

would be virtually impossible 'to achieve by any other teaching technique 

that can be used in the classroom, as . opposed to the "real world". 

- ' It is of ten, erroneously , ass\nn^3^hat the computer should be used to 

repycate as far as possible the function of the human teacher, (Indeed 

it is , a common error in technological development to devise a machine that 

performs i^ef f iaientlyeSa^ly because it is made to ape human performance 

— for example the common ide^of a robot that looks, wa'lk^^and talks like 

a human would be an incredibly/ inefficient use of machinery . for most 

purposes.), Computer-Assisteld Instruction (as opposed to Computer-Manage< 

Learning, for example) often te^^s to start from the basis that the learning 

material should.be presented by the computet' and confin'&d to this mode /of 

presentation. Howeve^,^ there is no^ reason why the computer need play such 

a direct t-eaching role. It may for instance be used as a learning aiq, 

much like a dictionary br calculator, and indeed this is what Winter Ifias 

done in using the machine to display various properties of human gaitL The 

computer is' also, a convenient testing dqyice (it was used for this puji 

In near ly all of the COMIT modules) and a usef ul-theans of diagnosing 

learner's knowledge and abilities so as to guide students to material,- ' 

uniquely suited to their individual needs. 

This ability at efficient diagnosis, anjrl the ±dek that the computer 
# ' - • ■■ ! 

can cater to individual learning differences in a way that is not posbihle 
« ■ - \ 

' in the classroom, is a potential advantage of CAL that is frequently |>ut 

forward 'by the system's advocates. Unfortunately in practice CAL, in compion 

with -previous instructional technologies such as programmed instruction, havS 

a r^ather disappointing record of achievement. In reality, few.-modules 

employ' very sophisticated diagnosis of student aptitudes (let alone/ student ^ 

learning styles) and most of the branching pechpiques used for remedial 

purposes are fairly p^rlmltive, even in c^comparlson with what was possible on 

. th-0; teaching machines of 13 yeats ago. There are good reasons why this 

potential strength of CAL has^ds yet gone largely unreall?:ed: the def It'leney 



rpose 
each 



X12 



■■ ■ ■ '^i . - - • ■ ■ • . 

- / 105. 

■ . ■ - • i'- , , • - \ \ : , * 

is probably largely to the iininen^ feff^jrt of time and commitment ^ 

involved to write and progratmne matei:^|for this purpose. Hence the modules 
that in pt'inciple could cater to a wide'^r^airiety of individual differences, 
and which are capable of continual improvementjfm* the basis of a detailed 
examination of student responses, may remain in a crude an(J unmodified form , 
indefinitely. Naturally, it is too early to^ say whether this will be so for 
the programmes developed in COMIT, although the fact that the system in its 
present fonfl has been dismantled makes the ques-t ion somewhat unfair or 
irrelevant. 

If it is accepted that some demonstration of student learning is 
important evidence oP teaching success, then attenti'ftn turns to the types 
of evidence that might be useful for this purpose. Evaluation of any 
ti^achl^ng int^i;vention may be carried out in terms of a change in knowledge 
or^dn-the case of the teaching of a skill) behaviour compared to the 
abilities demons t rated immediately prior to the start of the teaching. Such 
"pretest - post-test" coihpar isons , if' they are to be meaningful, should be 
related to, carefully stated learning objectives that can be, operationamed 
in terms of specific behaviour change. (Even then it is often difficult 
to know whether the change was due to the teaching, to some extraneous 
factor, or a combination of both.) Sometimes an attempt is made to supple- 
ment evidence of such changes on the part of leatners by compajcative 
measurements for a group pf people to whom the material was presented in some 
other way (or to whom ±t was not presented at all). A full discussion of 
the design and shortcomings of such evaluative strategies is beyond the 
scope of the present paper. Suffice it to say that several of the contri- 
butions to the present collection describe attempts at ' evaluation that 
incorporate pre- and post-tests as well as comparisons with other teaching: 
techniques. Some general comments about just what, conclusions can be drawn 
from such studies' are made at the end of this paper. 

(b) Stu dent^ Ax^itudes. A measurement of learners* attitudes to a system of 
instruction, while l^ss important than evidence of student learning, is of 
value, not least because favourable attitu,des .are likely to facilitate 
learning (or, conversely, unfavourable attitudes are likely to be highly 
disadvantageous for learning) . Nearly all of the preceding papers report 
on student reactions to their experlenoc with the COMTT syntem, gathered 
either by means of a structured questionnaire or from informal Intoractioii 
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with the module author. As is pften the- case with teaching innovations 
(indeed with any teaching techiiiquc) both positive and negative attitudes 
are reported. Negative commenits. relate to the monotony arid lack of flex-^ 
ibllity of the "system: aspects that different authors attempted to doal^with 
•by different means, such as humour or- the provision of ancillary notes. 
Another feature of the system frequently mentioned in a negative vein was 
its impersonality compared to a real, live t^a^er, and one attempt to 
combat this feature and add la "human element" to the learning experience 
is described, by Avedon and ^tewart. 

This brings up the important question of^ the "man-machine interface" 
and the related, more general question of motivation in learning, Unfor- 

0 

tunately our knowledge of the process by which humans relate to machines 
in both positive and negative ways, as well as our understanding of why 
machines are exciting for some individuals and frightening for others , is 
disappointing to this point, notwithstanding increasing attention by 
researchers to the question. It is interesting, for example, that most of 
M^Bean's students could spend no more than two or three hours at the COMIT 
terminal, while we know that students of similar age and intelligence will 
spend much longer periods passively watching a somewhat similar machine 
(television) or interacting with machines that seem on J}ie face of it^ far 
less challenging (pinball machines, slot machines, and so on) 

In terms of positive attitudes' to COMIT, many students expressed 
pleasure at the idea of proceeding at? their own pace ^and being able.\o 
review the material presented aptrabutes that are not confirmed to CAL, 
-but are great lyr facilitated by sucJRa system. In the case of favourable 
qomments to the general notion of learning via such a system (and tl^ere were 
many such comments) it is important to recognize that there may be a con- 
founding influence caused by the very novelty of the system and the fact 
that learners were part of a special experiment (the "Hawthorne effect"). 
Oa the other hand, some of the nej^qtive comments may come from conservative 
students who are resistant to any n^w type of learning. Furthermore the 
greatest area of negative reaction which Concerned the technical problems 
with the system — relates to foatures of COMIT that could almo^^t: eu^rtaluJy 
be remedied in the future. 
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(c) ftfects on Teachers , Th^e ^attitudes of authors and instructors to the 
experience of working with^COMIT reflect the same divergence of opinion as 
do those of the student learners, and. range from cbnfllderable cnthuBlnsm 
about the general potential of the aystem to a measure of dlslllus lonment, ' 
with positive attitudes predominating .(perhaps not surprisingly in view of 
tlie need to justify the great amounts/of ' time and energy expended on pi*e- 
paring the modtiles) . ^ The negative comments were clearly influenced by 
frustrations with technical aspects of the system (frequent breakdowns and ^ 
slow response tj.me) and tthe immense amount of authoring time required. 

Of even more interest, however, are the comments by authors abqut the 
teaching/ learning process itself that have applicability -far beyond the 
COMIX system or computer assisted learning. .For example, three of the 
authors, as a result of working on the preparation of their modules, soon 
realized that their knowledge of the material ^ud their understanding of 

^the best way to. organize the material for efficient learning was fa,r less 
than they had assumed at the outset, in spite of several years of lect'uring 
on basically the same topics.. If this was primarily a self-insight, there 
were other insights into the learning process Itself, For example, four of 
the authors came to the^ realization that learning is essentially an active 
process that requires students to respt>nd constantly and frequently, rather 
than passively receiving transmitted material, ^s happens frequently in so 
much traditional teaching. Authors also commented on another learning 
principle that is well known to psychologists but frequently ignored' in the 
Classroom, the notion that effective learning requires frequent and 
immediate information to students about how well they are progressing with 
the learning task. At least one of the authors raised the' important issue 
of social factors in learning, to what extent students benefit from working 
alone at their own pace as opposed to learning with arid from other people. 
Hence McBean felt that many of students were able to benefit from, being 

able to work in pairs who-n reviewing the material in the module. 

It is important to realize that these insights about the learning . ^ 
process are not restricted to learning by computer, biit are generally appli- 
cable. At the same time, it is instructive tc) see how effectively they 
were brought home by tho. experience of working with a new instructional 

^system, such as COMIT, that places new dcMnands the teacher, especially 
with regard to the way ho or she analy ^'-^^^^ » ^^^^lects^ and structures the 
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Material to be learned-. Even for experlfiTiced teachers it appears that 
involvement with a ,new medium of instruction leads to a rethinking of 
principles and techniques previously taken somewhat for granted. To this 
extent experience with COMIT is of Undoubted benefit to those involved in 
designing and adynlnistering the different modules* 

(d) Institutional Effects , Over the three year existence of the COMIT 
project there was a ^ considerable outlay^ of institutional funds and resources 
.and an even greater Investment of time on the part of the project staff and 

; module authors , not to mention the effprt and involvemen^t of the many 
hundreds of student learners. Yet . t^e essential components of the system ^ 
have now be^n disbanded with lit tie likelihood that the University of \ 
Waterloo — at lesast in the short term — will change its basic methods of 
teaching. Why^ is this tVie- .case , ^nd why has this been the ¥ate "of so-' ^ 
many experiments in educational technology in 'established educational 
institutions? - 

Part of the answer, lies in the inherent conservatism of academics — 
and students'^* — when it comes to the implementation of new methods of, 
-teaching and learni,ng. Additional reasons, relate to the basic complement 
of -ikills that most faculty bring to the teaching process (fev faculty are 
trained in pedagogy and most learn through the examples of their own 
teachers), to the considerable costs involved (to cite just one example, 
the costs^of providing and servicing an adequate number of terminals), and 

\ to the general reorganization of the university system that would be 
-required in terms of timetabling, classroom arrangements, and so on. 
Furthermore, at a time when universities are threatened with severe, fin- 
ancial stringencies and the very job security of university teachers is 
challenged, the political climate is probably not conducive to the intro- 
Miction of a radical change in teaching methods, especially when the argu- 
ments'" for effectiveness are equivocal. Hence in the immediate future 
innovations like COmIT will probably remain in the domain of experiments to 
be tried and tested in forward-looking institutions, by faculty who are 
willing to devote their time and enthusiasm largely for the reward (jf their 
own self-satisfaction and personal insights into the learning process. , . 

(e) Extra-Institutional Effects . In his introduction to this collection 
Moore states that one aim of the COMIT project was to see what Impl icfitioils 
might result from the experiment for extramural education . He points out 
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that this system seems to have particular promise in that its basic compd- 
nent is an ordinary colour television monitor .(though supplemented, with a \ 
number of aopMsticated add! tions si^h as^ a li^ht pen^ keyboard, and so on) 
It"seems pro^aVle, however, that any hopes to introduce such a system on a 
widespread basis are rather premature.' \ \ ' 

In the fjirst... place> there appear Xo Be formidable technical obstacles 
to the efficient operation of su^h a system, even when it is used "in- 
house'' on a\. fairly small scale, and with constant^ technical, assistance 
^v^il^'ble to stude^nts^^ each terminal . Secondly, the authoring time 

required to produte material is vast, especially when it is borne in mind 
that the segments represented , by the modules described here comprise only 
a fraction of the material normally presented in the one-term courses of 
which they form pa^t. Thirdly,- it is probate that the outside clientele 
for such a system is probably considerably more conservative about pedagogy 
ical matters than* the student body in established institutions of higher 
education. In this regard the British Open University is an interesting 
case in point. Although jthis is a remarkable social innovation, from a 
technological and pedagogical point of view it is fairly orthodox, relying 
on the traditional mainstay^ of. further education correspondence 
courses^ personal tutors, textbooks (albeit extremely well\organized oi)es) 
and traditional lectures during the compulsory periods in U^sidence. 
The television component of the Open University is just tpat — good tele- 
vision programming, involving none of the interactive elelnent that is a 
principal feature of COMIT and CAL in general. 
COMIT and the Future Role of Computers in Edu catj^; 

A numb,€>r of the experiments with COMIT described in previous papers^ 
have attempted to compare the system with other teaching methods. In 
last analysis, however, such an approach is probably unproductive. Rather, 
we should try to analyze which media of instruction, including the huitian 
teacher, are most suited fot particular pedagogical ends and for particular 
individual learners. This is a research question of great importance, » 
about which very little is known as yet. 

In the COMIT system the computer, it could be argued, is besrt seen 
not as a teacher, but as a "super-coordinntor** of instruction — 



potentially better than the human teafi^^r at this task, though whether 
acceptable in this role by the human li^Arner is something that haii yet to 
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be determiaed. Certainly CQMIT^is far from cheap a/^a coordinating system, 
even though it is far less >expensive in this role than when it i^ used as 
a direct teaching device J it must then be asked if it"" is worth this coat, 
or whether we shall continue to use our existing systems, largely^human, or 
some alternative non-human, non-computerized system, such as written module 
that are capable of guiding learners to a variety bf existing resources. 

if we accept the computer as a useful coordinator of instructional 
resources, then we must seriously question the notion that all the material 
. involved has to be presented directly on the computer itself. The system 
ijill depend ultimately,,! would suggest, not solely on J.ts efficiency, but^ 
>also on Its flexibility. This is the future challenge of computers in 
education, and an issue for which the COMIT experiment has provided 
, invaluable empirical datt. . 
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A SYMPOSIUM ON COMIT 

Presented under the auspices of the 
Computers in Education Committee and the 
■ ^ Teaching Resource Person 



'FINAL PROGRAMME 



Place: MC 5158 
Datfe: Thurs, 6 April , 19 
Time: 1:00 p.m. 



Call to Order 

G,C\ Andreh)i^\ Chairman^, Computers in Education. Committee 

••■ • ' ' ' ' ■ • \ 

Introductory Remarks • f . , 

T.A. Brzustowski^' Vice-President (Academic) . 

A Brief Summary of the GOM^T Project . - - 

: :^:R. Moore, COMIT PrO'lj^'c't Director \ • - 

■ i ^ > ■ ,. ' ■ • ; 'V- 

Some COMIT:'Hi,ghlights 

EJ./^lkeer, IBMj Project Coordinator 

Representative Papers by COMIT Participants: ' ' 

1. COMIT: Th& Leisure Experience ^ ^' 

E,M. Avedon and T.O, Stewart, Dep't of ■ Recreation 

2. Armchair Survey Sampling: An Aid in Teachlpg Survey Design 

*Af.£'. Thompson, Dep't of Statistics-. ' ' V , , 

3. Student ..Keijporise to Gomputer-Aided Te'aching ' ' ' \ .,. ■ 



E.A. McBeaji Dep^ t of Civi t:En(jinej3ring 
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4. COMIT and Offenslvt^ Line Play in Football 

'Wl Delahey, Dep't of Athlctica ^ , 

5. COMIT and Hockey gystoms! 

B.C. McKiUop, Dep't of Ath!cti^\^ 

6. A COMIT EnglLsb Module ,: 

P.D, Beam, Dep ' t of Enu iirJi " \ - 

7. Computer-Assisted Instruction in Organ L c Syn thes Is 

V.A, Snieokui^, Dcp't of Chemit^tvy . 

General Discussion and Summary ' ^ ' 

Moderator: V'.A'. Knapper, Trai'Jif^uj lu'soui*,^: P(n*iu)n 

RECEPTiON : Following the Symposium, there w L j-^l \v a recej^r Ion in tlie /| :.Vj - () : U) piu 
Faculty Club for all persona attending the Symposium. Wine .and c:lieese (aiM^i'^^x. ) 
will be servedk , 

No te ; All persons wishin ^ ^ to attend the Symposiunv. must ' con t act ' 
Heather Baker (Ext. 3132) t^^ ^ ^rve a place 
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